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ABSTRACT 


The  Fibonacci  search  technique  for  maximizing  a  unlmodal 
function  of  one  real  variable  Is  generalized  to  the  case  of  a 
given  first  evaluation.  This  technique  Is  then  employed  to 
determine  the  optimal  sequential  search  technique  for  the 
maximization  of  a  concave  function. 


I.  Introduction 

A  real  function  f:  [aib]  ■*  R,  where  a  <  b,  Is  called 


(1.1) 


unimodal. 


If  there  are  x,  x  c  [a,b]  such  that  f  is  Increasing  for  x£x 
and  nonincreasing  for  x  ^  x»  decreasing  for  x  ^  x  and  non¬ 
decreasing  for  X  ^  X  (Fig.  1) . 

(1.2)  If  f  Ca  unimodal^  then  the  interval  [x»x]  ocmiata  of 
all  maxima  of  f. 

Proof’,  f  is  constant  in  [x»x] ,  since  it  is  by  definition  non- 
increasing  for  X  2.  X  as  well  as  nondecreasing  for  x  ^  x.  If 
X  <  X,  then  f(x)  <  f(x)  as  f  increases  in  (a,x].  If  x  >  x, 
then  f(x)  <  f(x)  as  f  decreases  in  [x,b].- 

The  definition  of  unimodality  is  chosen  so  as  to  guarantee 


(1.3)  whenever  a  unimodal  function  f  has  been  evaluated  for 

two  arguments  x^^  and  ^2  with  a  _<  Xj^  <  X2  ^  b,  then 
some  maximum  of  f  must  lie  in  [Xj^,b]  if  f(xj^)  ^  f(x2) 
and  in  [a,X2]  if  f(Xj^)  jif(x2). 

Proof:  If  f(Xj^)  f(x2),  then  and  X2  cannot  be  both  in  that 
portion  of  the  interval  [a,b]  in  which  the  function  decreases.  In 
other  words,  x  cannot  lie  to  the  left  of  x^^.  Thus  x  c  [Xj^.b], 


a  b 


Figure  1.  Example  of  a  unimodal  function. 
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imd  X  li  a  maximum  of  f  by  (1.2).  Similarly,  if  f(x^)  £  f(x2), 
then  X  c  [a^x^]* 

A  sequential  search  baaed  on  (1.3)  will  successively  narrow  dewn 
the  Interval  In  whlcli  a  maximum  of  f  Is  known  to  lie.  Such  an 
Interval  Is  called  the 

(1.4)  interval  of  uncertainty. 

Kiefer  [3]  has  asked  the  question  of  optimally  conducting  this  search, 
and  answered  It  by  developing  his  well  known  Fibonacci  search. 

The  Fibonacci  search  gives  a  choice  of  two  arguments  for  which 
to  make  the  first  evaluation.  But  what  happens  if  by  mistake  or  for 
some  other  reason  the  first  evaluation  took  place  at  some  argument 
other  than  the  two  optimal  ones?  How  does  one  optimally  proceed  from 
there? 

In  this  paper,  we  shall  therefore  ask  and  answer  the  question 
for  an  optimal  sequential  search  plan  with  given  arbitrary  first 
evaluation.  The  resulting  technique  Is  applied  to  Improving  on 
Fibonacci  search  for  functions  known  to  be  concave.  The  technique  may 
also  be  of  interest  in  the  context  of  stability  of  Fibonacci  search  in 
the  presence  of  round-off  errors  as  studied  by  Overholt  [6]  and 
Boothroydt  [1]  (see  also  Kovallk  and  Osborne  [4]). 

2.  Length  of  Uncertainty 

In  what  follows  we  assume  that  a  «  0  and  b  ■  1.  Furthermore, 
we  shall  permit  zero  distances  between  two  arguments  of  evaluation, 
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Interpreting  eech  such  occurrence  as  evaluating  the  (not  neceesarlly 
unique  or  finite)  derivative  of  the  function  f.  A  more  careful 
analysis  would  take  Into  account  the  smallest  Justifiable  distance 
c  between  arguments  (Kiefer  [3],  Oliver  and  Wilde  [5]). 

By 


Lj^(x) ,  0  1  X  1  1  » 

we  denote  the  length  to  which  the  interval  of  uncertainty  (1.4)  can 
surely  be  reduced  by  k  evaluations  In  addition  to  a  first  one  at 
X.  Extending  a  recursive  argument  due  to  Johnson  [2],  we  obtain 


(2.1)  Lj^(x)  -  minjMj^(x),  M|^(l“x)}  , 


where 


min 

x^^l 


Proof:  Let  y  denote  the  first  function  argument  over  which  we 
have  control.  If  x_<  y  ^  1,  then  the  two  possible  intervals  of 
uncertainty  are  [0,y]  and  [x,l].  The  former  contains  the  point 
of  evaluation  x.  The  best  upper  bound  for  the  length  of  the 
Interval  of  uncertainty  after  the  remaining  k  -  1  evaluations  Is 
given  by 

(2.2)  . 

Similarly,  y  is  the  evaluation  point  in  [x,l],  leading  to  the 
best  upper  bound 
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(2.3)  • 

Whathar  [0,y]  or  [x,l]  If  tht  first  Intarval  of  uncartalnty 
depends  on  the  result  of  the  evaluation  at  y:  If  f(y)  >  f(x), 
then  [0,y],  If  f(y)  &  f(x),  then  [x,l].  Hence  the  maximum 
M|^(x)  of  the  two  expressions  (2.2)  and  (2.3)  Is  the  best  result 
achievable  If  y  Is  selected  between  x  and  1.  The  expression 

analogously  describes  the  best  result  achievable  If  y  Is  between 
0  and  X.  Since  we  control  the  choice  of  y,  we  can  choose  the 
smaller  one  of  these  two  expressions;  and  this  gives 

Lj^(x)  •  minjMj^(x),  Nj^(x)|  . 

Introducing  for  0  x  ^  y  ^  1, 

S^(x.y)  ;  -  ,  yL^.^C^)}  , 

we  have 


Mj^(x)  -  min  Sj^(x,y),  Nj^(x)  -  min  S.  (y,x)  . 
x^^l  O^'^x 

Now  for  U  ^  X  ^  y  ^  1, 


(2.4)  Sj^(x,y)  -  Sj^(l-y,l-x)  . 


Therefore,  Nj^(x) 


Mj^(l-x)  ,  and  (2.1)  is  proved. - 


At  the  beginning,  the  interval  of  uncertainty  is  the  entire 
interval  in  which  the  function  is  to  be  examined.  A  single  function 
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•valuation  at  any  point  x  doas  not  change  this  iltuatlon.  Hence 

1  . 

I 

Wa  then  have 


LqCx) 


M^(x) 


min  nuix|l-x,y|  ■  inax|l-x,x|  ■  Mj^(l-x) 
x^^l 


Hence 


(2.5)  Lj^(x)  -  max 


|l-x,x|  .  I 

For  k  ^  2,  we  claim  (Fig.  2): 


-X  for*  0  ^  X  ^  'i 
x  for*  ‘i  ^  X  ^  1  . 


(2.6) 

L^(x)  . 

1-x 

F 

X 

for 

0  £  X 

< 

1  ^ 

)  Vi 

for 

fki 

^k+l 

1  1-X 

1  Vl 

for 

^  X 

X 

F. 

for 

"k 

R  - 

k-1 

^k+1 


<  X  <  'i 


'k 

*"  ^k+1 

1  X  <.  1  , 


wheiK!  Fq  ■  1,  ■  1,  F^  ■  2,  Fj  ■  3,  ...»  Fj^  ■  Fj^_2  + 

the  Fibonacci  m.rrbera. 


Proof:  The  case  k 


yi.i<7> 


/y-x 


-  2  requires  special  treatment, 
for  (x,y)  e  jo  ^  ^ 

for  (x,y)  c  1  ^  1  ij  , 


From  (2.5)  , 


are 


V  X 
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(l-x)L^( 


ill) 

1-x^ 


y-x  for  (x,y)  t  0  1 ^ 

1-y  for  (x,y)  c  h  1 1  ■ 


We  are  now  able  to  determine  S2(x,y)  in  each  of  the  four  regions 
n  Bj  separately: 


A^  n  B^: 

S2(x,y) 

■  max|y-x,  y-x] 

i  -  y-x. 

A^  n  B^: 

S2(x,y) 

-  max|y-x,  l-yj 

i  -  1-y. 

A2  n 

S2(x,y) 

■  X  by  (2.4)  and  (1-y,  1-x) 

c  A.  Ob. 

X  z 

X  if  y  ^ 

1-x 

A,  n  B,: 

S,(x,y) 

■  max|x,l-y|  “j 

z  z 

z 

1-y  if  y  ^ 

1-x. 

The  sets 

A^  and 

Bj  are  represented  in  Fig. 

3.  They  are  triangles 

formed  by  the  line  segments  marked  and  ,  respectively,  and 

the  corresponding  opposite  corner  of  the  triangles.  The  feathered 
lines  are  the  minimum  lines  with  respect  to  constant  values  of  x, 
i.e.  if  proceeding  vertically  the  intersection  with  the  feathered 
lines  marks  a  minimum.  The  function  Mjj(x)  is  defined  to  be  the 
value  of  this  minimum.  Hence 


M,,(x) 


1-x 

2 

X 


if  0  1  X  <  ^ 
if  "j  ^  X  ^  1  . 


By  (2.1)  we  then  have  finally 


1-x 


if 

if 

if 

if 


0  <  X 


f  1  X  1  1. 
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n 

Sk(x,y)  ■  max 

K-i 

IZ2L.  1 

’  V2^ 

- 

h-2 

n  B,  : 

4 

Sj^(x,y)  ■  max  . 

(^k-1 

1=2^1 

’ 

.  kJL 

^k-1 

gives 

1-x  <  2(l-y) 

or 

y-x  _<  1-y 

• 

n  B2: 

Sj^(x,y)  -  max  • 

iCa 

1 

n  B^: 

Sj^(x,y)  -  max  ■ 

Iv. 

y-x  ) 

’  F  f 

k-2  ' 

X 

\-2 

gives 

2x  ^  y  or 

X  ^  y 

-  X  . 

n  B,  ; 

4 

Sj^(x,y)  •  max  - 

I'L 

lUL.1 

xlUL 

\-l 

|x,  l-y|  . 


gives  2x-y  <  0,  and  since  (x,y)  c  gives  +  yFj^  < 

Indeed,  multiplying  the  former  inequality  by  Fj^  ^  and  adding  it 


*^-1  * 

^  V2* 

iis_  £:i_l 

-  riiL. 

\-2  ’  ^k-2  ^ 

<N| 

1 

1 

y-x  1-y  ) 

V2  ’ 

^k-1 

n  Sj^(x,y)  ■  max 


Sj^(x,y)  -  n>ax since  (x.y)  e 

gives  (l-x)F,^  ^  ^  (l-y)Fj^,  and  therefore  “ 

-  (l-y)F,.i  i  (l-y)F^  -  (l-y)F,.j  •  (l-y)F^.2. 

A^OB^;  S|^(x,y)  •  max  ^  — max|x,  l-y|. 

k— 1  k— 1  k— 1 

The  schematic  representation  of  Sj^(x,y)  then  is  given  by  Fig.  4.  There 
are  breaks  along  the  line  x  ■  1  -  y  in  areas  A2nB2  and  A^HB^.  The 
feathered  lines  are  again  those  boundaries  of  linearity  regions  at  which 
Sj^  decreases  for  fixed  x.  The  abscissae  of  intersection  points  of 


feathered  lines  are  therefore  critical.  The  first  one  of  these  criti¬ 
cal  arguments  we  denote  by  v.  It  is  the  abscissa  of  the  intersection 
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polnt  of  the  line 


(2.7) 


which 


(2.8) 


ki  -  Jszi 

l-x 


\  * 


separates  from  and  the  line 


X 

y 


k-2 


which  separates  from  A^.  Elimination  of  y  yields 

F. 


V  ■ 


■k-2 


F  +  F 

'k-2 


The  next  critical  argument  clearly  has  the  value  .  The  third  one, 
which  we  call  w,  Is  the  Intersection  of  the  line 

F. 


(2.9) 


kl 

l-x 


k-1 

\  ’ 


which  sep.^ratea  B^  from  B^,  and  the  line 
F. 


(2.10) 


X 

y 


k-1 

fk  ■ 


which 


separates  A^  and  A^.  Elimination  of  y  yields 


w 


kll 

^k+1 


The  last  critical  argument  finally  has  the  value  -j  . 


For  0  X  V  the  values  of  Sj^(x,y)  at  the  intersection  of  the 

vertical  through  x  with  the  two  feathered  lines  (2.8)  and  (2.9)  are 
potential  minima.  The  equations  of  these  lines  can  be  rewritten  as 


^k-2 


l-x 


and 


h-1 


l-x 


V 
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As  these  terms  also  represent  the  value  of  S^(x,y),  we  have 
Mj^(x)  -  for  0  £  X  V. 

For  V  <  X  <  y  locally  minimal  points  are  to  be  found  on  line 

(2.9)  and  in  the  area  where  S.  (x,y)  assumes  the  value  ■= -  .  Now 

x^v  gives  xFj^  ^  (1-x)Fj^_2 

k-2  k  k 

for  V  ^  X  ^  y  . 


For  T  ^  X  f.  w  only  the  line  (2.9)  is  interesting,  and 


still  takes  the  value 


1-x 


For  w  ^  X  ^  y  beyond  the  minimum  is  assumed  within  the  entire 


line  segment  which  happens  to  meet  the  area  in  which  Sj^(x,y)  -  y 


Thus  finally 

(2.11) 


'  fov  0  _<  X  _< 

'k  \+l 


M^(x)  - 


for 


^k-1 


k-l  ‘k+1 

and  (2.6)  follows  immediately  from  (2.1).- 


^  X  £  1  , 


k-1 


Note  also  that  (2.11)  implies 


(2.12) 


L^(x)  - 


M,(x) 


for  0  X  ^  y 


Mj^(l-x)  for  Y  —  ^  * 


3.  Search  Strategy. 

In  the  previous  section,  we  have  determined  the  optimal  length  of 
uncertainty  L.  (x),  which  can  be  achieved  in  k  evaluations  in  addition 

tC 

to  one  evaluation  at  x  c  [0,1].  We  have  yet  to  describe  a  search  strategy 


*1...  »,*!.•  f  '-H  • 


which  realizes  .  This  amounts  to  specifying  the  argument  y  of 

the  first  evaluation  In  addition  to  x.  In  view  of  (2.12),  this  reduces 
to  determining  y  such  that  ■  Sj^(x,y)  for  given  x  between 

0  and  a  task  which  has  been  performed  already  while  calculating 

If  0  £  X  V,  then  there  are  two  optimal  solutions  y,  since 
S.  (x,y)  ■  ■= —  along  both  feathered  lines  in  Fig.  A.  This  non- 
uniqueness  Is  not  surprising.  Indeed,  if  x  ■  0,  then  the  evaluation 
at  this  argument  does  not  contribute  at  all  towards  narrowing  the 
Interval  of  uncertainty,  and  the  optimal  continuation  Is  Just  plain 
Fibonacci  with  one  evaluation  wasted.  And  In  this  case  there  are  two 
optimal  arguments,  namely  the  first  and  second  (k-l)-st  order 
Fibonacci  points 


^k-2  ^k-1 

*^k  ’  ^k 


(3.1)  If  0  ^  X  <  -  Vp- — -  ,  then  any  of  the  two  (k-D-st  oiKiev 

‘k-2 

Fibonaooi  points  in  the  interval  [x,l]  is  an  optimal  evaluation 


point 


’^k-2  ,  ,  "’'k-l  *  ^k-2 

S’!  '  *  *  X"  ‘  ' - K - 

k  k 

F  xF  +  F 

.  k-1  ,,  V  k-2  Vl 

y  -  X  +  —  (1-x) - - - 

^  *^k  'k 


In  both  intervals  v  x  ^  -j  and  ^  x  w,  the  optimal 


solution  y  Is  unique. 
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*  k—  2  k“  1 

(3.2)  If  •=rT5 - l^lv -  the  cptimal  evaluation  povnt  y 

*k-2 

ie  the  first  (k-l)-8t  order  Fibonaooi  point  of  the  interval  [x,l]. 

y  *ally,  If  w  _<  X  _<  "I-  ,  then  the  optimal  solutions  fill  an 
entire  Interval. 

F  . 

(3.3)  Let  If  y^  is  suah  that  x  is  the  second 

V2  ... 

(k-l)-Bt  order  Fibonacci  point  in  (0,yQ],  then  all  points  in 
(l-x,yQ]  are  optimal  evaluation  points. 

The  following  rule  will  always  yield  an  optimal  solution: 

(3.4)  Theorem:  An  optimal  aearcn  strategy  after  an  arbitrary  first 
evaluation  at  Xq  e  [a,b]  is  as  follatvs.  If  c  x  ^  d  are  suah 
that  (c,d]  constitutes  the  interval  of  uncertainty  after 
additional  evaluations,  and  if  x  is  the  argument  for  which  the 
function  has  been  evaluated  already ,  then: 

(1)  If  X  lies  between  c  and  the  first  (k-l)-th  order 
Fibonacci  points  in  lc,d]j  then  choose  y  as  the  first  (k-il)-th 
order  Fibonacci  point  in  (x,dl. 

(ii)  If  X  lies  between  the  two  (k-)l)-th  order  Fibonacci 
points  of  [c.d],  then  choose  y  as  the  syrmetria  image  of  x  in 
[c,d] ,  i.e.  y  -  c  +  d  -  X. 

(ill)  If  X  lies  between  d  and  tne  second  of  the  two  (k-i)-th 
order  Fibonacci  voints  in  [c^d],  then  choose  y  as  the  second 
(k-l)-th  order  Fibonacci  point  in  lc,x]. 


We  shall  refer  to  any  sequential  search  strategy  in  keeping  with 
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(3.1,  2,  3),  in  particular  the  rule  described  In  Theorem  (3.4),  as 
(3.5)  modified  Fihonaooi  aeavoh  . 

If  the  Interior  of  the  Interval  of  uncertainty  does  not  contain  an 
argument  at  which  the  function  has  been  evaluated  already,  then  the 
select.'.i  n  of  the  next  evaluation  by  modified  Fibonacci  search  will 
be  the  same  as  in  standard  Fibonacci  search. 

4.  Spies 

Intervals  of  uncertainty  with  nonoptlmal  evaluation  points  may 
be  the  result  of  the  following  situation.  Suppose  In  maximizing  a 
function  we  avail  ourselves  of  the  services  of  a  "spy".  This  spy 
operates  as  follows:  every  time  an  Interval  of  uncertainty  has 
been  based  on  the  results  of  prior  evaluations,  he  Is  consulted,  and 
as  a  result  of  this  consultation,  the  Interval  of  uncertainty  may  some¬ 
times  be  further  reduced  (remaining  an  interval)  without  additional 
evaluations.  One  cannot  expect,  however,  that  the  remaining  evaluation 
point  (If  there  Is  any)  Is  In  optimal  position  within  the  new  Interval 
of  uncertainty. 

In  this  case,  there  Is  a  question  whether  the  additional  Infor¬ 
mation  should  be  accepted.  It  Is  Indeed  conceivable  that  reducing 
the  Interval  of  uncertainty  and  subsequently  continuing  from  a  non¬ 
optlmal  evaluation  point  would  In  the  final  analysis  lead  to  a  larger 
Interval  of  uncertainty  than  Ignoring  the  additional  Information  and 
doing  a  straightforward  Fibonacci  search.  That  this  Is  not  so,  is 
essentially  the  content  of  the  following 


} 


(4,1)  Theorem:  The  optimal  policy  in  the  prceenoe  of  an  un- 
prediotaPle  spy  is  to  heed  hia  advioe  and  to  proaeod.  from  the 
interval  of  unaertccinty  ao  achieved  by  modified  Fibonacci  search 
with  respect  to  the  remaining  evaluation  point  if  there  ia  any. 

Proof:  Let  [c,d]  be  the  Interval  of  uncertainty  as  determined  by 
the  previous  step  of  the  search^  and  let  [c,d],  c  ^  c  ^  d  ^  d  , 
be  the  Interval  of  uncertainty  after  consulting  the  spy.  As  the  spy 
Is  unpredictable,  there  may  be  no  further  Information  forthcoming. 

This  Is  the  worst  case,  since  even  If  the  spy  is  providing  Information, 
It  need  not  be  heeded.  Thus  all  we  have  to  show  is  that  we  do  not 
worse  by  proceeding  form  [c,d]  than  from  any  other  Interval  [c*,d*] 
with  [c,d]  D  [c*,d*]  D  [c,d]. 

Now  let  X  be  the  evaluation  point  in  [c,d].  Then  we 
distinguish  two  cases,  depending  on  whether  x  c  [c,dj  or  not. 

Suppose  X  E  lc,d],  then  x  e  (c*,d*J.  Working  on  the  latter 


Interval,  the  best  we  can  do  In  1  remaining  steps  Is  reducing 
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The  case  In  which  x  e  [c,d]  remains  to  be  considered.  Suppose 
X  <  c  <  d.  Since  we  proceed  by  standard  Fibonacci  in  any  Interval  of 
uncertainty  not  containing  x  in  its  interior,  starting  with  [c,d]  is 
certainly  better  than  starting  with  [x,d]C  [c.d],  and  we  have  already 
seen  that  [x,d]  is  better  than  any  interval  between  [c.d]  and  [x,d]. 

A  spy  is  called 

(4.3)  almost  imppediatable  , 

if  for  each  subinterval  [c*,d*]  of  the  interval  of  uncertainty  [c.d], 
which  results  from  the  evaluation  pattern,  the  spy  has  the  option  of 
reducing  it  only  to  an  interval  [c,d]  which  contains  [c*,d*].  Plainly, 
we  still  have 

(4.4)  Tncovem:  Tne  optimal  policij  in  the  presence  of  an  almost 
unprcdiataole  spy  Is  to  need  his  advice  and  to  proceed  from  the 
interval  of  uncertainty  so  achieved  by  modified  Fibonacci  search 
with  respect  to  the  remahiing  evaluation  point  if  there  is  any. 

5.  Concave  Functions 

We  shall  see  that  a  "spy”  is  available  if  the  unimodal  function 
to  be  maximized  is  known  to  be  concave. 

A  function  f:  [a,b]  ->  R  is 

(5.1)  concave 


in  [a,b]  if 
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f(Ax  +  uy)  ''  +  yf(y) 

holds  for  all  x,y  e  [a,b],  X,  w  >  0  and  X  +  u  ■  The  function 
is 

(5.2)  stri-ctly  aonaave 
if 

f(.\x  +  uy)  Xf(x)  +  uf(y) 

holds  for  all  x,y,X,u  which  are  as  above  and  satisfy  in  addition 
X  y  and  X,;i  >  0.  We  state  without  proof  that 

(5.3)  avcpu  uppers  semiaontinuoua  aonaave  funation  on  [a,b] 
ie  unirnodal. 


Without  tile  additional  hypothesis  of  upper  semicontinuity,  (5.3^ 
does  not  hold  as  there  are  concave  functions  without  maximum  on  [a,b]. 


Now  consider  two  points  ■  (x^,f(x^)) 


p  • 


(Xj ,f (Xj))  , 


x^  <  Xj ,  of  the  graph 


and 


G(f)  j(x,f(x))  :  x  e  [a,b]j  , 

let  L^j  be  the  straight  line  through  P^,  P^,  Concavity  implies 


that  the  graph  of  f  lies  not  below  in  [x^,Xj]  and  not  above 

in  the  remainder  of  the  interval  [a,b].  Hence  if  five  points  of 
the  graph  G(f), 


Pq  (xQ,f(xQ)),  ....  (x^,f(x^)) 


^0  "  <  x^  <  x^  ‘  x^ 


with 
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and 

f(x2)  ^  i  ■  1»2, 

are  known,  then  that  part  of  the  graph  G(£)  that  lies  above 
la  contained  In  the  union  of  the  two  triangles  and  A^  formed  by 

Lpi.Lp,  L23  and  Lj^2»  ^23.  respectively.  f(x2)  is  a 

lower  bound  for  the  maximum  value  of  f.  Therefore 

(5.4)  a  maximum  of  f  muat  lie  in  the  intereeotion  of  4j^UA2 
with  the  hoHzontal  through  P^.  (Fig.  5) 

The  information  that  the  function  f  is  concave  can  thus  be  used 
in  order  to  reduce  the  Interval  of  uncertainty. 

In  order  to  complete  the  description  of  the  proposed  search 
method  for  concave  functions,  a  few  more  conventions  are  necessary. 

At  the  ends  of  the  Interval  [a,b],  we  pretend  that  the  function 
has  value  -<",  and  if  it  has  been  evaluated  there,  we  pretend  that 
there  are  two  values  for  the  same  d>scissa,  one  of  the  values  being 
infinite.  Three  evaluations  will  therefore  reduce  the  Interval  of 
uncertainty  as  Indicated  in  Fig.  6. 

We  proceed  to  show  that 

(5.5)  aonaaviiy  is  an  almost  unpredictable  spy  (4.3) 

Proof:  Suppose  we  have  five  points 

a  4  Xjj  <  X2  <  X3  i  x^  i  b, 

where  Xq  and  x^^  may  both  coincide  with  the  left  end-point  a,  and 
similarly  x^  and  x^  may  coincide  with  the  right  end-point  b.  For 
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with  1  0,  A,  we  have  finite  function  values  f (x^) ,  wheraas 

f(xQ)  and  f(x^)  are  possibly  infinite,  provided  Xq  -  a  or  x^  ■  b, 
respectively.  We  suppose  furthermore  chat 

fCXg)  <  f(Xj^)  <  fCx^)  <  f(Xj)  <  f(x^)  . 

Let  [c,d]  be  the  interval  of  uncertainty  that  results  in  view  of 
concavity.  Observe  that 

X2e[c,d]  . 

Now  select  any  x  with  c  ^  x  &  x^,  x^  <  x,  and  assume  that 
f(x)  satisfies 

f(x)  -  f(x2)  +  ^(x  -  X2) 

for  some  6  with 

f(x.)  -  f<x.) 

°  ^  ^  X  -'x -  • 

Then  the  new  interval  of  uncertainty  taking  concavity  into  account 

will  be  of  the  form  [c,d],  where 

_  6(x-x.) (x2-x) 

c  -  X  + -  >  X  . 

f(x2)  -  f(Xj^)  -  5(x2-x) 

The  difference  c  -  x  measures  the  reduction  of  uncertainty  due  to 

concavity.  Now  by  definition  of  5, 

5(x-Xj^)(x2-x)  6(x2-x^)^ 

^(5*2^  ”  "  5(x2-Xj^)  -  f(x2)  -  f(Xj^)  -  5(x2-Xj^) 

and  the  last  term,  independent  of  x,  goes  to  zero  as  6  goes  to  zero. 
In  other  words,  the  contribution  of  concavity  beyond  unimodality  becomes 
arbitrarily  small  as  f(x)  approaches  f(x2)  from  below,  but  not 
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asBumlng  It. 

What  happens  if  f(x)  approaches  f(x2)  from  above?  Assume 
6  >  0  and 


If  m  >  0 
then 


f(x)  ■  f(x2)  -  i5(x-X2)  . 

denotes  the,  -  possibly  infinite  slope  of  line 
f(x)  -  f(x2) 

/c  +  -  for  m  •  -H” 


Ic 


for  m  ■  “ 


_  f(x)  -  f(x2) 

“  '^2  f(x3)  -  f(x2)  ’ 

determine  the  new  Interval  [c,d]  of  uncertainty,  taking  into 
account  concavity.  The  reduction  beyond  unimodality  is  the  sum  of 
c  -  c  and  X2  -  d.  Now 

_  -(SCx-Xj)  6(x2-X3^) 

c  -  c  ■  -  i  - - -  > 

m  m 

_  6(x-X2)  6(x2-Xj^) 

^^2  ■  “  f(x3)  -  f(x2)  -  f(x2)  -  f(x3T  ’ 

and  again  the  gain  beyond  unimodality  becomes  arbitrarily  small  as 
f(x)  approaches  f(x2)  from  above  without  assuming  it. 

The  symmetric  argument  can  be  carried  out  for  X2  <  x  i  d  and 
X  <  X3.  This  then  will  establish  concavity  as  an  almost  independent 


spy.- 
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Coinblning  (5.5)  with  Theorem  (4.4)  yields 

(5.6)  Theorem:  Using  aonoavity  as  a  spy  in  a  modified  Fibonaooi 
search  is  the  optimal  strategy  for  reducing  the  interval  of  un¬ 
certainty  of  concave  functions, 

6.  Final  Remarks 

From  the  proof  of  Theorem  (5.6)  it  is  apparent  that  the  proposed 
search  strategy  for  concave  function  Is  "rdn  sup"  rather  than  "min  max". 
In  other  words,  the  problem  is  not  well  set.  Indeed,  it  makes  probably 
more  sense  for  concave  functions  to  decrease  the  uncertainty  in  the  value 
of  the  minimum  than  in  its  location. 

A  similar  argument  as  was  used  for  proving  (5.5)  can  be  emploved 
to  siiow  that  fore  each  c  >  0  and  each  positive  integer  k  there  is  a 
concave  function  for  which  the  reduction  of  uncertainty  by  optimal 
search  is  improved  by  less  than  e  over  unimodal  search.  In  general, 
however,  the  improvement  will  be  drastic,  in  particular  if  the  function 
is  well  rounded,  so  to  speak,  and  has  a  maximum  in  the  interior. 
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